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(54) Title: HARDWARE/SOFTWARE CODESIGN SYSTEM 
(57) Abstract 

A hardware/software codesign system for making an electronic 
circuit which includes both dedicated hardware and software con- 
trolled resources. The codesign system receives a behavioural de- 
scription of the target electronic system and automatically partitions 
the required functionality between hardware and software, while be- 
ing able to vary the parameters (e.g. size or power) of the hardware 
and/or software. Thus, for instance, the hardware and the processor 
for the software can be formed on an FPGA, each being no bigger 
than is necessary to perform the desired functions. The codesign sys- 
tem outputs a description of the required processor (which can be in 
the form of a net list for placement on the FPGA), machine code to 
run on the processor, and a net list or register transfer level descrip- 
tion of the necessary hardware. It is possible for the user to write 
some parts of the description of the target system at register transfer 
level to give closer control over the operation of the target system, 
and the user can specify theprocessor or processors to be used, and 
can change, for instance, the partitioner, compilers or speed estima- 
tors used in the codesign system. The automatic partitioning may 
be performed by using a genetic algorithm which estimates the per- 
formance of randomly generated different partitions and selects an 
optimal one of them. 
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HARDWARE/SOFTWARE CQDESIGN SYSTEM 

The present invention relates to a system for designing and producing an 
5 electronic circuit having a desired functionality and comprising both hardware 
which is dedicated to execution of certain of the functionality and a software- 
controlled machine for executing the remainder of the functionality under the 
control of suitable software. 

It is well known that software-controlled machines provide great flexibility 
10 in that they can be adapted to many different desired purposes by the use of 

suitable software. As well as being used in the famili ar general purpose computers, 
software-controlled processors are now used in many products such as cars, 
telephones and other domestic products, where they are known as embedded 
systems. 

1 5 However, for a given function, a software-controlled processor is usually 

slower than hardware dedicated to that function. A way of overcoming this 
problem is to use a special software-controlled processor such as a RISC processor 
which can be made to function more quickly for limited purposes by having its 
parameters (for instance size, instruction set etc.) tailored to the desired 
20 functionahty. 

Where hardware is used, though, although it increases the speed of 
operation, it lacks flexibility and, for instance, although it may be suitable for the 
task for which it was designed it may not be suitable for a modified version of that 
task which is desired later. It is now possible to form the hardware on 
25 reconfigurable logic circuits, such as Field Programmable Gate Arrays (FPGA's) 
which are logic circuits which can be repeatedly reconfigured in different ways. 
Thus they provide the speed advantages of dedicated hardware, with some degree 
of flexibility for later updating or multiple functionahty. 

In general, though, it can be seen that designers face a problem in finding 
30 the right balance between speed and generality. They can build versatile chips 
which will be software controlled and thus perform many different functions 
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relatively slowly, or they can devise application-specific chips that do only a 
limited set of tasks but do them much more quickly. 

A compromise solution to these problems can be found in systems which 
combine both dedicated hardware and also software. The hardware is dedicated to 
5 particular functions, e.g. those requiring speed, and the software can perform the 
r emainin g functions. The design of such systems is known as hardware-software 
codesign. Within the design process, the designer must decide, for a target system 
with a desired functionality, which functions are to be performed in hardware and 
which in software. This is known as partitioning the design. Although such 
0 systems can be highly effective, the designer must be familiar with both software 
and hardware design. It would be advantageous if such systems could be designed 
by people who have familiarity only with software and which could utilise the 
flexibility of configurable logic resources. 

The present invention provides a hardware/software codesign system 
which can target a system in which the hardware or the processors to run the 
software can be customised according to the functions partitioned to it. Thus 
rather than the processor or hardware being fixed (which effectively decides the 
partitioning), the codesign system of this invention includes a partitioning means 
which flexibly decides the partitioning while varying the parameters of the 
hardware or processor to obtain an efficient overall design that is close to op tim al. 

In more detail it provides a codesign system for producing a target system 
having resources to provide specified functionality by: 

(a) operation of dedicated hardware; and 

(b) complementary execution of software on software-controlled 
machines; 

the codesign system comprising means for receiving a specification of said 
functionality; partitioning means for partitioning implementation of said 
functionality between (a) and (b) and for customising said hardware and /or said 
machine in accordance with the selected partitioning of the functionality. 

Thus the target system is a hybrid hardware/software system. It can be 
formed using configurable logic resources in which case either the hardware or the 
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processor, or both, can be formed on the configurable logic resources (e.g. an 
FPGA). 

In one embodiment of the invention the partitioning means uses a genetic 
algorithm to optimise the partitioning and the parameters of the hardware and the 
5 processor. Thus, it generates a plurality of different partitions of the functionality 
of the target system (varying the size of the hardware and/or the processor 
between the different partitions) and estimates the speed and size of the resulting 
system. It then selects the best found partitioning on the basis of the estimates. In 
the use of a genetic algorithm, a variety of partitions are randomly generated, the 
1 0 poor ones are rejected, and the remaining ones are modified by combining aspects 
of them with each other to produce different partitions. The speed and size of 
these are then assessed and the process can be repeated until a sufficiently good 
partition is produced. 

The invention is applicable to target systems which use either customizable 
hardware and a customizable processor, or a fixed processor and customizable 
hardware, or fixed hardware and a customizable processor. Thus the customizable 
part could be formed on an FPGA, or, for instance, an ASIC. 

The system may include estimators for estimating the speed and size of the 
hardware and the software controlled machine and may also include an interface 
generator for generating interfaces between the hardware and software. In that 
case the system may also include an estimator for estimating the size of the 
interface. The partitioning means calls the estimators when deciding on the 
quality of each possible partitioning. 

The software-controlled machine can comprise a CPU and the codesign 
system comprises means for generating a compiler for the CPU as well as means 
for describing the CPU where it is to be formed on customizable logic circuits. 

The codesign system can further comprise a hardware compiler for 
producing from those parts of the specification partitioned to hardware a register 
transfer level description for configuring configurable logic resources (such as an 
FPGA). It can further include a synthesizer for converting the register transfer 
level description into a net list. 
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The system can include a width adjuster for setting a desired data word size, 
and this can be done at several points in the desired process as necessary. 

Another aspect of the invention provides a hardware/ software codesign 
system which receives a specification of a target system in the form of a 
behavioural description, i.e. a description in a programming language such as can 
be written by a computer programmer, and partitions it and compiles it to 
produce hardware and software. 

The partitioning means can include a parser for parsing the input 
behavioural description. The description can be in a famili ar computer language 
such as C, supplemented by a plurality of predefined attributes to describe, for 
instance, parallel execution of processes, an obligatory partition to software or an 
obligatory partition to hardware. The system is preferably adapted to receive a 
declaration of the properties of at least one of the hardware and the software- 
controlled machine, preferably in an object-oriented paradigm. It can also be 
adapted such that some parts of the description can be at the register transfer level, 
to allow closer control by the user of the final performance of the target system. 

Thus, in summary, the invention provides a hardware/ software codesign 
system for making an electronic circuit which includes both dedicated hardware 
and software controlled resources. The codesign system receives a behavioural 
description of the target electronic system and automatically partitions the 
required functionality between hardware and software, while being able to vary 
the parameters (e.g. size or power) of the hardware and/or software. Thus, for 
instance, the hardware and the processor for the software can be formed on an 
FPGA, each being no bigger than is necessary to form the desired functions. The 
codesign system outputs a description of the required processor or processors 
(which can be in the form of a net list for placement on the FPGA), machine code 
to run on the processor, and a net list or register transfer level description of the 
necessary hardware. It is possible for the user to write some parts of the 
description of the target system at register transfer level to give closer control over 
the operation of the target system, and the user can specify the processor or 
processors to be used, and can change, for instance, the partitioner, compilers or 
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speed estimators used in the codesign system. The automatic partitioning can be 
performed by using an optimisation algorithm, e.g. a genetic algorithm, which 
generates a partitioning based on estimates of performance. 

The invention also allows the manual partition of systems across a number 
5 of hardware and software resources from a single behavioural description of the 
system. This provision for manual partitioning, as well as automatic partitioning, 
gives the system great flexibility. 

The hardware resources may be a block that can implement random logic, 
such as an FPGA or ASIC; a fixed processor, such as a microcontroller, DSP, 
10 processor, or processor core; or a customizable processor which is to be 

implemented on one of the hardware resources, such as an FPGA-based processor. 
The system description can be augmented with register transfer level descriptions, 
and parameterised instantiations of both hardware and software library 
components written in other languages. 

The sort of systems which can be targeted include:- 
a fixed processor or processor core, coupled with custom hardware; 
a set of customizable (e.g. FPGA-based) processors and custom hardware; 
a system on a chip containing fixed processors and an FPGA; and 
a PC containing an FPGA accelerator board. 

The use of the advanced estimation tec hni ques in specific embodiments of 
the invention allows the system to take into account the area of the processor that 
will be produced, allowing the targeting of customizable processors with 
additional and removable instructions, for example. The estimators also take into 
account the speed degradation produced when the logic that a fixed hardware 
resource must implement nears the resource's size limit. This is done by the 
estimator reducing the estimated speed as that limit is reached. Further, the 
estimators can operate on both the design before partitioning, and after 
partitioning. Thus high level simulation, as well as simulation and estimation after 
partitioning, can be performed. 

Where the system is based on object oriented design, this allows the user to 
add new processors quickly and to easily define their compilers. 
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The part of the system which compiles the software can transparently 
support additional or absent instructions for the processor and so is compatible 
with the parametrization of the processor. 

Preferably the input language supports variables with unspecified widths, 
which are then unified to a fixed width using a promotion scheme, and then 
mapped to the widths available on the target system architecture. 

Further, in one embodiment of the invention, it is possible for the input 
description to include both behavioural and register transfer level descriptions, 
which can both be compiled to software. This gives support for very fast 
simulation and allows the user control of the behaviour of the hardware on each 
clock cycle. 

The present invention will be further described by way of non-limitative 
example with reference to the accompanying drawings in which: 

Figure 1 is a flow diagram schematically showing the codesign system of 
one embodiment of the invention; 

Figure 2 illustrates the compiler objects which can be defined in one 
embodiment of the invention; 

Figure 3 is a block diagram of the platform used to implement the second 
example circuit produced by an embodiment of the invention; 

Figure 4 is a picture of the circuit of Figure 3; 

Figure 5 is a block diagram of the system of Figure 3; 

Figure 6 is a simulation of the display produced by the example of Figs. 3 

to 5; 

Figure 7 is a block diagram of a third example target system; and 
Figure 8 is a block diagram showing a dependency graph for calculation of 
the variables in the Figure 7 example. 

This description will later refer to specific examples of the input 
behavioural or register transfer level description of examples of target systems. 
These examples are reproduced in A ppendices, namely:- 

Appendix 1 is an example register transfer level description of a 
simple processor. 
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Appendix 2 is a register transfer level description of the main process flow 
in the example of Figs. 3 to 5. 

Appendix 3 is the input specification for the target system of Fig. 8. 

The flow of the codesign process in an embodiment of the invention is 
5 shown in Figure 1 and will be described below. The target architecture for this 
system is an FPGA containing one or more processors, and custom hardware. 
The processors may be of different architectures, and may communicate with each 
other and with the custom hardware. 

1 0 The Input Language 

In this embodiment the user writes a description 1 of the system in a C-like 
language, which is actually ANSI C with some additions which allow efficient 
compilation to hardware and parallel processes. This input description will be 
1 5 compiled by the system of Figure L The additions to the ANSI C language 
include the following: 

Variables are declared with explicit bit widths and the operators working 
on the variables work with the required precision. This allows efficient 
implementation in hardware. For instance a statement which declares the width of 
20 variables (in this case the program counter pc, the instruction register ir, and the 
top of stack tos) is as follows 

• unsigned 12 pc, ir, tos 
The width of the main data path of the processor in the target system may be 
declared, or else is calculated by the partitioner 7 as the width of the widest variable 
25 which it uses. 

The "par" statement has been added to describe process-level parallelism. The 
system can automatically extract fine-grained parallelism from the C-like description 
but generating coarse-grained parallelism automatically is far more difficult. 
Consequently the invention provides this attribute to allow the user to express 
30 parallelism in the input language using the "par" statement which specifies that a 

following list of statements is to be executed in parallel. For example, the expression:- 
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par { 

parallel_port (port) ; 
SyncGenO ; 
} 

5 

means that two sub-routines, the first which is a driver for a parallel port and 
the second which is a sync generator for a video display are to be executed in parallel. 
All parts of the system will react to this appropriately. 

Channels can be declared and are used for blocking, point-to-point 
10 synchronized communication as used in occam (see G. Jones. Programming in occam. 
Prentice Hall International Series in Computer Science, 1987, which is hereby 
incorporated by reference) with a syntax like a C function call. The parallel processes 
can use the channels to perform distributed assignment. Thus parallel processes can 
communicate using blocking channel communication. The keyword "chan" declares 
1 5 these channels. For example, 

chan hwswchan; 

declares a channel along which variables will be sent and received between the 
20 hardware and software parts of the system. Further, 

send (channeM, a) 

is a statement which sends the value of variable a down channel_l; and 

25 

receive (channel_2, b) 

is a statement which assigns the value received along channel_2 to variable b. 
The hardware resources available are declared. The resources may be a 
30 customizable processor, a fixed processor, or custom hardware. The custom hardware 
may be a specific architecture, such as a Xilinx FPGA. Further, the architecture of the 
target system can be described in terms of the available functional units and their 
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interconnection. 

To define the architecttire "platforms" and "channels" are defined. A platform 
can be hard or soft. A hard platform is something that is fixed such as a Pentium 
processor or an FPGA. A soft platform is something that can be configured like an 
5 FPGA-based processor. The partitioner 7 understands the keywords "hard" and 

"soft", which are used for declaring these platforms and the codes can be implemented 
on any of these. 

This particular embodiment supports the following hard platforms: 
Xilinx 4000 series FPGAs (eg the Xilinx 4C85 below); 
1 0 Xilinx Virtex series FPGAs; 

Altera Flex and APEX PLDs; 

Processor architectures supported by ANSI C compilers; 
and the following soft platforms each of which is associated with one of the 
parametrisable processors mentioned later: 

15 

FPGAStackProc, FPGAParallelStackProc, FPGAMips. 

An attribute can be attached to a platform when it is declared: 

20 platform (PLATFORMS) 

For a hard platform the attribute PLATFORMS contains one element: the 
architecture of the hard platform. In this embodiment this may be the name of a 
Xilinx 3000 or 4000 series FPGA, an Altera FPGA, or an x86 processor. 
25 For a soft platform, PLATFORMS is a pair. The first element is the 

architecture of the platform:- 

FPGAStackProc, FPGAParallelStackProc or FPGAMips 

30 and the second is the name of the previously declared platform on which the 

new platform is implemented. 
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Channels can be declared with an implementation, and as only being able to 
link previously declared platforms. The system 7 recognises the following channel 
implementations . 

5 PCDJus - a channel implemented over a PCI bus between an FPGA card and a 

PC host. 

FPGAChan - a channel implemented using wires on the FPGA. 
The following are the attributes which can be attached to a channel when it is 
declared: 

10 

type(CHANNELTYPE) 

This declares the implementation of the channel. Currently 

1 5 CHANNELTYPE may be PCIBus or FPGAChan. FPGAChan is the 

default. 

from(PLATFORM) 

PLATFORM is the name of the platform which can send down 
20 the channel. 

to(PLATFORM) 

PLATFORM is the name of the platform which can receive 
from the channel. 

25 

The system 7 checks that the declared channels and the platforms that use them 
are compatible. The communication mechanisms which a given type of channel can 
implement are built into the system. New mechanisms can be added by the user, in a 
similar way to adding new processors as will be explained below. 
30 Now an example of an architecture will be given. 
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Example Architecture 

/* Architectural Declarations */ 

// the 4085 is a hard platform -- call this one meetea 
5 board 

hard meeteaBoard _attribute_ ( (platf orm(Xilinx4085) )) ; 

// the pentium is a hard platform -- call this one 
hostProcessor 

10 hard hostProcessor _attribute_ ( (platf orm (Pentium) )) ; 

// procl is a soft platform which is implemented 
// on the FPGA on the meetea board 
soft procl _attribute_ ( (platf orm (FpgaStackProc, 
15 meeteaBoard) ) ) ; 

Example Program 

void main ( ) 
20 { 

// channell is implemented on a PCIBus 

// and can send data from hostProcessor to meetea 

board 

chan channell _attribute_ ( (type (PCIBus) , 
25 from (hostProcessor) , 

to (meeteaBoard) ) ) ,- 
// channel2 is implemented on the FPGA 
chan channel2 _attribute_ ((type (FPGAChan) ) ) ; 

30 /* the code */ 
par { 

// code which can be assigned to 

// either hostProcessor (software), 

// or procl (software of reconf igurable 

35 processor) , 

// or meetea board (hardware) , 
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// or left unassigned (compiler decides). 

// Connections between hostProcessor 

/ / and procl or meetea must be over the PCI 

// (channell) 

/ / Connections between procl and hardware 
// must be over the FPGA channel (channe!2) 



10 } 



Attributes are also added to the input code to enable the user to specify 
whether a block is to be put in hardware or software and for software the attribute 
also specifies the target processor. The attribute is the name of the target platform. 
1 5 For example:- 

{ 

int a, b; 
a = a + b; 

0 } _attribute_ ( (platform (hostProcessor) ) ) 

assigns the operation a + b to Host Processor. 

For hardware the attribute also specifies whether the description is to be 
5 interpreted as a register transfer (RT) or behavioural level description. The default is 
behavioural. For example:- 

{ 

int a, b; 
) par { 

b = a + b; 
a m b; 

} _attribute_ ( (platform (meeteaBoard) , level (RTL) ) ) 
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would be compiled to hardware using the RTL compiler, which would 
guarantee that the two assignments happened on the same clock cycle. 

Thus parts of the description which are to be allocated to hardware can be 
written by the user at a register transfer level, by using a version of the input language 
5 with a well defined timing semantics (for example Handel-C or another RTL 

language), or the scheduling decisions (i.e. which operations happen on which clock 
cycle) can be left to the compiler. Thus using these attributes a block of code may be 
specifically assigned by the user to one of the available resources. Soft resources may 
themselves be assigned to hardware resources such as an FPGA-based processor. The 
1 0 following are the attributes which can be attached to a block of code: 

platform(PLATFORM) 

PLATFORM is the name of the platform on which the code will be 
implemented. This in conjunction with the level () attribute (see 
1 5 below) implies the compiler which will be used to compile that code. 

level(LEVEL) 

LEVEL is Behavioural or RTL. Behavioural description will be 
scheduled and may be partitioned. RTL descriptions are passed straight 
20 through the RTL synthesiser e.g. a Handel-C compiler. 

cyclesfNUMBER) 

NUMBER is a positive integer. Behavioural descriptions will be 
scheduled in such a way that the block of code will execute within that 
25 number of cycles, when the compiler is able. An error is generated if it 

is not possible. 

For partitioning of programs which include pointers, the concept of address 
space partitioning is introduced. This is to solve the problems of inefficiency or 
30 implementation which can arise with pointers which point to locations which are 

partitioned to different physical memories. For instance, some pointers may point to 
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locations in memory on hardware, and some may point to locations in RAM used by a 
processor. Such partitioning can result in, for example, excessive data transfers being 
necessary between the different memories. To solve these problems, on compilation 
every variable and function in the program is assigned its own address space. The 
5 % compiler locates variables and functions which, because of operations between them, 
must share the same address space, and it then unifies these address spaces. If as a result 
of manual partitioning a unified address space is split across a plurality of physical 
memories, accesses to the address spaces and communications between them are 
synthesised by the compiler as appropriate. During manual partitioning of the system 
0 the user can use the standard C "memcpy" function to pass blocks of data between 
address spaces to improve the efficiency of the program by reducing the number of 
individual data transfers. 

Thus the use of this input language which is based on a known computer 
language, in this case C, but with the additions above allows the user, who could be a 
5 system programmer, to write a specification of the system in famili ar behavioural 
terms like a computer program. The user only needs to learn the additions above, 
such as how to declare parallelism and to declare the available resources to be able to 
write the input description of the target system. 

This input language is input to the parser 3 which parses and type checks the 
) input code, and performs some syntax level optimizations, (in a standard way for 

parsers), and attaches a specific compiler to the appropriate blocks of code based on the 
attributes above. The parser 3 uses standard techniques [Aho, Sethi and UUman; 
"Compilers Principles, Techniques, and Tools"; Addison Wesley known as The 
Dragon Book", which is hereby incorporated by reference] to turn the system 
» description in the input language into an internal data structure, the abstract syntax 
tree which can be supplied to the partitioner 7. 

The width adjuster 5 uses C-like techniques to promote automatically the 
arguments of operators to wider widths such that they are all of the same width for 
instance by concatenating them with zeros. Thus this is an extension of the 
promotion scheme of the C language, but uses arbitrary numbers of bits. Further 
adjustment is carried out later in the flow at 5a and 5b, for instance by ANDing them 



WO 00/38087 



PCT/GB99/04338 



-15- 

with a bit mask. Each resources has a list of widths that it can support. For example a 
32 bit processor may be able to carry out 8, 16 and 32 bit operations. Hardware may 
be able to support any width, or a fixed width datapath operator may have been 
instantiated from a library. The later width adjustment modules 5a and 5b insert 
5 commands to enable the width of operation in the description to be implemented 
correcdy using the resources available. 

Hardware/Software Partitioning 

1 0 The partitioner 7 generates a control/data-flow graph (CDFG) from the 

abstract syntax tree, for instance using the techniques described in G. de Micheli 
"Synthesis and Optimization of Digital Circuits"; McGraw-Hill, 1994 which is hereby 
incorporated by reference. It then operates on the parts of the description which have 
not already been assigned to resources by the user. It groups parts of the description 
1 5 together into blocks, "partitioning blocks", which are indivisible by the partitioner. 
The size of these blocks is set by the user, and can be any size between a single 
operator, and a top-level process. Small blocks tend to lead to a better partition which 
takes longer to generate; larger blocks tend to lead to a worse partition which is 
generated more quickly. 
20 The algorithm used in this embodiment is described below but the system is 

designed so that new partitioning algorithms can easily be added, and the user can 
choose which of these partitioning algorithms to use. The algorithms all assign each 
partitioning block to one of the hardware resources which has been declared. The 
algorithms do this assignment so that the total estimated hardware area is no larger 
25 than the hardware resources available, and so that the estimated speed of the system is 
maximised. 

The algorithm implemented in this embodiment of the system is a genetic 
algorithm for instance as explained in D.E. Goldberg, "Genetic Algorithms in Search, 
Optimization and Machine learning", Addison- Wesley, 1989 which is hereby 
30 incorporated by reference. The resource on which each partitioning block is to be 
placed is represented by a gene. Additional genes represent possible parametrisations 
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of customizable processors. The fitness function returns the estimated system speed 
multiplied by a factor k, 0 < k^ 1; k = 1 if estimators say the partitioning will fit the 
available hardware; k < 1 otherwise, becoming rapidly less favourable as size increases. 
Different partitions are generated and estimated speed found. The user may set the 
5 termination condition to one of the following:- 

1) when the estimated system speed meets a given constraint; 

2) when the result converges, i.e. the algorithm has not resulted in 
improvement after a user-specified number of iterations; 

10 3) when the user terminates the optimisation manually. 

The partitioner 7 uses estimators 19, 21, and 23 to estimate the size and speed of 
the hardware, software and interfaces as described below. 

It should be noted from Figure 1 that the estimators and the simulation and 
1 5 profiling module 19 can accept a system description from several levels in the flow. 
Thus it is possible for the input description, which may include behavioural and 
register transfer level parts, to be compiled to software for simulation and estimation 
at this stage. Further, the simulator can be used to collect profiling information for 
sets of typical input data, which will be used by the partitioner 7 to estimate data 
20 dependent values, by inserting data gathering operations into the output code. 

Hardware Estimation 

The estimator 21 is called by the partitioner 7 for a quick estimation of the size 
25 and speed of the hardware parts of the system using each partition being considered. 
Data dependent values are estimated using the average of the vales for the sets of 
typical input data supplied by the user. 

To estimate the speed of hardware, the description is scheduled using a call to 
the behavioural synthesiser 11. The user can choose which estimation algorithm to 
30 use, which gives a choice between slow accurate estimation and faster less accurate 

estimation. The speed and area of the resulting RTL level description is then estimated 



WO 00/38087 



PCT/GB99/04338 



-17- 

using standard techniques. For FPGAs the estimtate of the speed is then decreased by 
a non-hnear factor determined from the available free area, to take into account the 
slower speed of FPGA designs when the FPGA is nearly full. 

5 Software Estimation 

If the software is to be implemented on a fixed processor, then its speed is estimated 
using the techniques described in J. Madsen and J. Grode and P.V. Knudsen and M.E. 
Petersen and A. Haxthausen, "LYCOS: the Lyngby Co-Synthesis System, Design 
1 0 Automation of Embedded Systems, 1977, volume 2, number 2, (Madsen et al) which is 
hereby incorporated by reference. The area of software to be implemented on a fixed 
processor is zero. 

If the target is customizable processors to be compiled by the system itself then 
a more accurate estimation of the software speed is used which models the 
1 5 optimizations that the software compiler 15 uses. The area and cycle time of the 
processor is modelled using a function which is written for each processor, and 
expresses the required values in terms of the values of the processor's parametrizations, 
such as the set of instructions that will be used, the data path and instruction register 
width and the cache size. 

20 

Interface Synthesis and Estimation 

Interfaces between the hardware and software are instantiated by the interface 
cosynthesizer 9 from a standard library of available communication mechanisms. Each 

25 communication mechanism is associated with an estimation function, which is used by 
the partitioner to cost the software and hardware speed and area required for given 
communicauon, or set of communications. Interfaces which are to be implemented 
using a resource which can be parametrised (such as a channel on an FPGA), are 
synthesised using the parametrizations decided by the partitioner. For example, if a 

30 transfer of ten thousand 32 bit values over a PCI bus was required, a DMA transfer 
from the host to an FPGA card's local memory might be used. 
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Compilation 

The compiler parts of the system may be designed in an object oriented way, 
providing a class hierarchy of compilers, as shown for example in Figure 2. Each node 
5 in the tree shows a class which is a subclass of its parent node. The top-level compiler 
class provides methods common to both the hardware and software flows, such as the 
type checking, and a system-level simulator used for compiling and simulating the 
high-level description. These methods are inherited by the hardware and software 
compilers, and may be used or overridden. The compiler cI^lss also specifies other, 
1 0 virtual, functions which must be supplied by its subclass. So the compile method on 
the hardware compiler class compiles the description to hardware by converting the 
input description to an RTL description; the compile method on the Processor A 
compiler compiles a description to machine code which can run on Processor A* 

There are two ways in which a specific compiler can be attached to a specific 
15 block of code: 



20 



30 



A) In command line mode. The compiler is called from the command lin e 
by the attributes mentioned above specifying which compiler to use for 
a block of code. 



B) Interactively. An interactive environment is provided, where the user 
has access to a set of functions which the user can call, e.g. to estimate 
speed and size of hardware and software implementations, manually 
attach a compiler to a block code, and call the simulator. This 
25 interactive environment also allows complex scripts, functions and 

macros to be written and saved by the user for instance so that the user 
can add a new partitioning algorithm.. 
The main compilation stages of the process flow are software or hardware 
specific. Basically at module 11 the system schedules and allocates any behavioural 
parts of the hardware description, and at module 15 compiles the software description 
to assembly code. At module 17 it also writes a parametrised description of the 
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processors to be used, which may also have been designed by the user. These 
individual steps will be explained in more detail. 

Hardware Compilation 

The parts of the description to be compiled into hardware use a behavioural 
synthesis compiler 1 1 using the techniques of De Micheli mentioned above. The 
description is translated to a control/data flow graph, scheduled (i.e. what happens on 
each clock cycle is established) and bound (i.e. which resources are used for which 
operations is established), optimised, and then an RT-level description is produced. 

Many designers want to have more control over the timing characteristics of 
their hardware implementation. Consequendy the invention also allows the designer 
to write parts of the input description corresponding to certain hardware at the 
register transfer level, and so define the cycle-by-cycle behaviour of that hardware. 

This is done by using a known RT-level description with a well-defined timing 
semantics such as Handel-C. In such a description each assignment takes one clock 
cycle to execute, control structures add only combinational delay, and 
communications take one clock cycle as soon as both processes are ready. With the 
invention an extra statement is added to this RT-level version of the language: "delay" 
is a statement which uses one clock cycle but has no other effect. Further, the "par" 
attribute may again be used to specify statements which should be executed in parallel. 

Writing the description at this level, together with the ability to define 
constraints for the longest combinational path in the circuit, gives the designer close 
control of the timing characteristics of the circuit when this is necessary. It allows, for 
example, closer reasoning about the correctness of programs where parallel processes 
write to the same variable. This extra control has a price: the program must be refined 
from the more general C description, and the programmer is responsible for thinking 
about what the program is doing on a cycle-by-cycle basis. An example of a 
description of a processor at this level will be discussed later. 

The result of the hardware compilation by the behavioural synthesiser 11 is an 
RTL description which can be output to a RTL synthesis system 13 using a hardware 



WO 00/38087 



PCT/GB99/04338 



-20- 

» 

description language (e.g. Handel-C or VHDL), or else synthesized to a gate level 
description using the techniques of De Micheli. 

RTL synthesis optimizes the hardware description, and maps it to a given 
technology. This is performed using standard techniques. 

Software Compilation 

The software compiler 15 largely uses standard techniques [e.g. from Aho, Sethi and 
Ullman mentioned above]. In addition, parallelism is supported by mapping the 
invention's CSP-like model of parallelism and communication primitives into the 
target model. For instance channels can mapped to blocks of shared memory 
protected by semaphores. CSP is described in C.A.R. Hoare "Communicating 
sequential processes." Prentice-Hall International Series in Computing Science. 
Prentice-Hall International, Englewood Cliffs, N.J. which is hereby incorporated by 
reference. 

Compound operations which are not supported directly by the processor are 
decomposed into their constituent parts, or mapped to operations on libraries. For 
example multiply can be decomposed into shifts and adds. Greedy pattern matching is 
then used to map simple operations into any more complex instructions which are 
supported by the processor. Software can also be compiled to standard ANSI C, 
which can then be compiled using a standard compiler. Parallelism is supported by 
mapping the model in the input language to the model of parallelism supported by the 
C compiler, libraries and operating system being used. 

The software compiler as exemplified in Figure 2 is organised in an object 
oriented way to allow users to add support for different processors (see Figure 2) and 
for processor parametrisations. For example, in the processor parametriser 17 unused 
instructions from the processor description are automatically removed, and support 
for additional instructions can be added. This embodiment of the invention, includes 
some pre-written processor descriptions which can be selected by the user. It contains 
parametrised descriptions of three processors, and the software architecture is designed 
so that it is easy for developers to add new descriptions which can be completely new 
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or refinements of these. The three processors provided are:- 

A Mips-Iike processor, similar to that described in [Patterson and Hennessy, 
Computer Organisation and Design, 2 nd Edition, Morgan Kauffman]. 

5 

A 2-cycle non-pipeline stack-based processor (see below). 

A more sophisticated multicycle non-pip elined stack-based processor, with a 
variable number of cycles per instruction, and hardware support for parallelism 
1 0 and channels. 

Thus the software compiler supports many processor parametrisations. More 
complex and unexpected modifications are supported by virtue of the design of the 
compiler (e.g. in an object oriented way as above), which allows small additions to be 

5 made ezsily by the user. Most of the mapping functions can be inherited from existing 
processor objects, minor additions can be made and a function used to calculate the 
speed and area of processor given the parametrizations of the processor and a given 
program. The output of the software compilation/processor parametrization process 
is machine code to run on the processor together with a description of the processor to 

0 be used (if it is not a standard one). 

Co-Simulation and Estimation 

The scheduled hardware, register transfer level hardware, software and 
5 processor descriptions are then combined. This allows a cycle-accurate co-simulation 
to be carried out, e.g. using the known Handel-C simulator, though a standard VHDL 
or Verilog simulator and compiler could be used. 

Handel-C provides estimation of the speed and area of the design, which is 
.written as an HTML file to be viewed using a standard broswer, such as Netscape. 
The file shows two versions of the program: in one each statement is coloured 
according to how much area it occupies, and in the other according to how much 
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combinational delay it generates. The brighter the colour for each statement, the 
greater the area or delay. This provides a quick visual feedback to the user of the 
consequences of the design decisions. 

The Handel-C simulator is a fast cycle-accurate simulator which uses the C-like 
nature of the specification to produce an executable file which simulates the design. It 
has an X-windows interface which, allows the user to view VGA video output at about 
one frame per second. 

When the user is happy with the RT-level simulation and the design estimates 
then the design can be compiled to a netlist. This is then mapped, placed and routed 
using the FPGA vendor's tools. 

The simulator can be used to collect profiling information for sets of typical 
input data, which will be used by the partitioner 7 to estimate data dependent values, 
by inserting data gathering operations into the output code. For example the source 
program can be compiled to platform independent bytecode. A suitable bytecode 
interpreter is then augmented such that accesses to memory (typically load and store 
instructions) can be traced. In this way the memory use behaviour of each part of the 
source program can be examined by executing the program and analysing the 
generated trace. 

However, a simplistic implementation of this technique suffers from the 
problem of generating a very large amount of profiling data. There are two alternative 
techniques to solve this problem: 

1. During execution of a single function (or set of functions grouped as a 
domain) a map of all the memory accessed is recorded. At the end of execution of the 
function only a compressed version of this map (compressed using a technique such as 
run-length encoding) is output. Since functions will typically tend to use blocks of 
memory in ranges, rather than a fully random access pattern, this results in significant 
savings in the size of the generated output. The output is then analysed post-hoc to 
determine where memory transfers would have taken place between domains of a 
partitioned system. 

2. Alternatively, some of the analysis can happen on-line during the 
execution of the program. In this case, a memory map is kept of the program which 
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records which functions (or groups of functions) have valid copies of small ranges of 
memory (micropages). When a function reads for an area of memory, this map is 
checked to see which functions have a valid copy of the data. If the current function 
was a valid copy no further action is taken. If no function has a valid copy of the data 
then it is taken as coming from an external source function. Otherwise a transfer from 
one of the other functions to the current function is recorded, and the map records 
that the current function now has a valid copy of the micropage. When a write occurs, 
exactly the same action takes place except the ownership of the micropage becomes 
only the current function, no other functions now possess valid (up-to-date) copies of 
the data in the given page. The result of the execution of a program in this way is a 2- 
dimensional table recording data transfers from functions to functions. This data can 
then be further analysed to give estimates for the performance of given partitions, be 
used to decide partitions, or be presented in a graphical form (such as a directed graph). 

Implementation Language 

The above embodiment of the system was written in objective CAML which is 
a strongly typed functional programming language which is a version of ML but 
obviously it could be written in other languages such as C. 

Provable Correctness 

A subset of the above system could be used to provide a provably correct 
compilation strategy. This subset would include the channel communication and 
parallelism of OCCAM and CSP. A formal semantics of the language could be used 
together with a set of transformations and a mathematician, to develop a provably 
correct partitioning and compilation route. 

Some examples of target system designed using the invention will be now 
described. 



EXAMPLE 1 - PROCESSOR DESIGN 
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The description of the processor to be used to run the software part of the 
target system may itself be written in the C-like input language and compiled using the 
codesign system. As it is such an important element of the final design most users will 
5 want to write it at the register transfer level, in order to hand-craft important parts of 
the design. Alternatively the user may use the predefined processors, provided by the 
codesign system or write the description in VHDL or even at gate level, and merge it 
into the design using the FPGA vendor *s tools. 

With this system the user can parametrise the processor design in nearly any 
1 0 way that he or she wishes as discussed above in connection with the software 
compilation and as detailed below. 

The first processor parametrisation to consider is removing redundant logic. 
Unused instructions can be removed, along with unused resources, such as the floating 
point unit or expression stack. 
1 5 The second parametrisation is to add resources. Extra RAMs and ROMs can 

be added. The instruction set can be extended from user assigned instruction 
definitions. Power-on bootstrap facilities can be added. 

The third parametrisation is to tune the size of the used resources. The bit 
widths of the program counter, stack pointer, general registers and the opcode and 
20 operand portions of the instruction register can be set. The size of internal memory 
and of the stack or stacks can be set, the number and priorities of interrupts can be 
defined, and channels needed to communicate with external resources can be added. 
This freedom to add communication channels is a great benefit of codesign using a 
parametrisable processor, as the bandwidth between hardware and software can be 
25 changed to suit the application and hardware/software partitioning. 

Finally, the assignment of opcodes can be made, and instruction decoding 
modified accordingly. 

The user may think of other parametrisations, and the object oriented 
processor description allows this. 
30 The description of a very simple stack-based processor in this style (which is 

actually one of the pre-written processors provided by the codesign system for use by 
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the user) is listed in Appendix 1. 

Referring to Appendix 1, the processor starts with a definition of the 
instruction width, and the width of the internal memory and stack addresses. This is 
followed by an assignment of the processor opcodes. Next the registers are defined; 
5 the declaration "unsigned x y, z* declares unsigned integers y and z of width x. The 
program counter, instruction register and top-of-stack are the instruction width; the 
stack pointer is the width of the stack's address bus. 

After these declarations the processor is defined. This is a simple non-pipelined 
two-cycle processor. On the first cycle (the first three-line "par"), the next instruction 
1 0 is fetched from memory, the program counter is incremented, and the top of the stack 
is saved. On the second cycle the instruction is decoded and executed. In this simple 
example a big switch statement selects the fragment of code which is to be executed. 

This simple example illustrates a number of points. Various parameters, such as 
the width of registers and the depth of the stack can be set. Instructions can be added 
15 by including extra cases in the switch statement. Unused instructions and resources can 
be deleted, and opcodes can be assigned. 

The example also introduces a few other features of the register transfer level 
language such as rom and ram declarations. 

20 EXAMPLE 2 - VIDEO GAME 

To illustrate the use of the invention using an application which is small 
enough to describe easily a simple Internet video game was designed. The target 
system is a video game in which the user can fly a plane over a detailed background 
25 picture. Another user can be dialled up, and the screen shows both the local plane and 
a plane controlled remotely by the other user. The main challenge for the design is 
that the system must be implemented on a single medium-sized FPGA. 

Implementation Platform 

30 

The platform for this application was a generic and simple FPGA-based board. 
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A block diagram of the board, a Hammond board, is shown in Figure 3, an d a picture 
is shown in Figure 4. 

The Hammond board contains a Xilinx 4000 series FPGA and 256kb 
synchronous static RAM. Three buttons provide a simple input device to control the 
plane; alternatively a standard computer keyboard can be plugged into the board. 
There is a parallel port which is used to configure the FPGA, and a serial port. The 
board can be clocked at 20 MHz from a crystal, or from a PLL controlled by the 
FPGA. Three groups of four pins of the FPGA are connected to a resistor network 
which gives a simple digital to analogue converter, which can be used to provide 12 bit 
VGA video by implementing a suitable sync generator on the FPGA. 

Problem Description and Discussion 

The specification of the video game system is as follows: 

The system must dial up an Internet service provider, and establish a 
connection with the remote game which will be running on a 
workstation. 

The system must display a reconfigurable background picture. 

The system must display on a VGA monitor a picture of two planes: 
the local plane and the remote plane. 

The position of the local plane will be controlled by the buttons on the 
Hammond board. 

The position of the remote plane will be received over the dialup 
connection every time it changes. 

The position of the local plane will be sent over the dialup connection 
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every time it changes. 

This simple problem combines some hard timing constraints, such as sending a 
stream of video to the monitor, with some complex tasks without timing constraints, 
such as connecting to the Internet service provider. There is also an illustration of 
contention for a shared resource, which will be discussed later. 

System Design 

A block diagram of the system is shown in Figure 5. The system design 
decisions were quite straightforward. A VGA monitor is plugged straight into the 
Hammond board. To avoid the need to make an electrical connection to the 
telephone network a modem was used, and plugged into the serial port of the 
Hammond board. Otherwise it would have been quite feasible to build a simple 
modem in the FPGA. 

The subsystems required are: 

serial port interface, 
dial up, 

establishing the network connection, 
sending the position of the local plane, 
receiving the position of the remote plane, 
displaying the background picture, 
displaying the planes. 

A simple way of generating the video is to build a sync generator in the FPGA, 
and calculate and output each pixel of VGA video at the pixel rate. The background 
picture can be stored in a "picture RAM". The planes can be stored as a set of 8x8 
characters in a "character generator ROM", and the contents of each of the characters 1 
positions on the screen stored in a "character location RAM". 



WO 00/38087 PCT/GB99/04338 



-28- 



Hardware/software partitioning 

The hardware portions of the design are dictated by the need of some parts of 
5 the system to meet tight timing constraints/ These are the video generation circuitry 
and the port drivers. Consequently these were allocated to hardware, and their C 
descriptions written at register transfer level to enable them to meet the timing 
constraints. The picture RAM and the character generator ROM and character 
location RAM were all stored in the Hammond board RAM bank as the size 
1 0 estimators showed that there would be insufficient space on the FPGA. 

The parts of the design to be implemented in software are the dial-up and 
negotiation, establishing the network, and communicating the plane locations. These 
are non-time critical, and so can be mapped to software. The program is stored in the 
RAM bank, as there is not space for the application code in the FPGA. 
15 The main function is shown in Appendix 2. The first two lines declare some 

communication channels. Then the driver for the parallel port and sync generator are 
started, and the RAM is initialised with the background picture, the character memory 
and the program memory. The parallel communicating hardware and software 
process are then started, communicating over a channel hwswchan. The software 
20 establishes the network connection, and then enters a loop which transmits and 
receives the position of the local and remote plane, and sends new positions to the 
display process. 

Processor Design 

25 

The simple stack-based processor from Appendix 1 was parametrised in the 
following ways to run this software. The width of the processor was made to be 10 
bits, which is sufficient to address a character on the screen in a single word. No 
interrupts were required, so these were removed, as were a number of unused 
30 instructions, and the internal memory. 
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Co-Simulation 

The RT-level design was simulated using the Handel-C simulator. Sample 
input files mimicking the expected inputs from the peripherals were prepared, and 
5 these were fed into the simulator. A black and white picture of the colour display is 
shown in Figure 6 (taken as a snapshot of the X window drawn by the co-simulator). 

The design was then placed and routed using the proprietary Xilinx tools, and 
successfully fit into the Xilinx 4013 FPGA on the Hammond board. 

This application would not have been easy to implement without the codesign 
1 0 system of the invention. A hardware-only solution would not have fitted onto the 
FPGA; a software-only solution would not have been able to generate the video and 
interface with the ports at the required speed. The invention allows the functionality 
of the target system to be partitioned while parametrizing the processor to provide an 
optimal system. 

15 

Real World Complications 

The codesign system was presented with an implementation challenge with this 
design. The processor had to access the RAM (because that is where the program was 

20 stored), whilst the hardware display process simultaneously had to access the RAM 
because this is where the background picture, character map and screen map were 
stored. This memory contention problem was made more difficult to overcome 
because of an implementation decision made during the design of the Hammond 
board: for a read cycle the synchronous static RAM which was used requires the 

25 address to be presented the cycle before the data is returned. 

The display process needs to be able to access the memory without delay, 
because of the tight timing constraints placed on it. A semaphore is used to indicate 
when the display process requires the memory. In this case the processor stalls until 
the semaphore is lowered. On the next cycle the processor then presents to the 

30 memory the address of the next instruction, which in some cases may already have 
been presented once. 
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The designer was able to overcome this problem using the codesign system of 
invention because of the facility for some manual partitioning by the user and 
describing some parts of the design at the register transfer level to give close control 
over those parts. Thus while assisting the user, the system allows close control where 
desired. 

EXAMPLE 3 - MASS-SPRING SIMULATION 



Introduction 

The "springs" programme is a small example of a codesign programmed in the 
C-like language mentioned above. It performs a simulation of a simple mass-spring 
system, with a real time display on a monitor, and interaction via a pair of buttons. 



1 5 Design 



The design consists of three parts: a process computing the motion of the 
masses, a process rendering the positions of the masses into line segments, and a 
process which displays these segments and supplies the monitor with appropriate 

20 synchronisation signals. The first two processes are written in a single C-like program. 
The display process is hard real-time and so requires a language which can control 
external signals at the resolution of a single clock cycle, so for this reason it is 
implemented using an RTL description (Handel-C in this instance). These two 
programs are shown in appendix 3. They will be explained below, together with the 

25 partitioning process and the resulting implementation. Figure 7 is a block diagram of 
the ultimate implementation, together with a representation of the display of the 
masses and springs. Figure 8 is a dependency graph for calculation of the variables 
required. 



30 



Mass motion process 
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The mass motion process first sets up the initial positions, velocities and 
acceleration of the masses. This can be seen in appendix 3 where positions pO to p7 are 
initialised as 65536. The program then continues in an infinite loop, consisting of: 
sending pairs of mass positions to the rendering process, computing updated positions 
5 based on the velocities of the masses, computing updated velocities based on the 

accelerations of the masses, and computing accelerations based on the positions of the 
masses according to Hooke's law. The process then reads the status of the control 
buttons and sets the position of one of the masses accordingly. This can be seen in 
appendix 3 as the statement "received (buttons, button^status);". 
1 0 This process is quite compute intensive over a short -period (requiring quite a 

number of operations to perform the motion calculation), but since these only occur 
once per frame of video the amortised time available for the calculation is quite long. 

Rendering process 

15 

The rendering process runs an infinite loop performing the following 
operations: reading a pair of mass positions from the mass motion process then 
interpolating in between these two positions for the next 64 lines of video output. A 
pair of interpolated positions is sent to the RTL display process once per line. This is a 
20 relatively simple process with only one calculation, but this must be performed very 
regularly. 

Display Process 

25 The display process (which is written in Handel-C) and is illustrated in 

appendix 3 reads start and end positions from the rendering process and drives the 
video colour signal between these positions on a scan line. Simultaneously, it drives the 
synchronisation signals for the monitor. At the end of each frame it reads the values 
from the external buttons and sends these to the mass motion process. 

30 



Partitioning by the codesign system 



WO 00/38087 



PCT/GB99/04338 



-32- 

The design could be partitioned in a large number of ways. The system could 
partition the entire design into hardware or into software, partition the design at a 
high level by the first two processes described above or it can partition the design at a 
lower level and generate further parallel processes communicating with each other. 
5 Whatever choice the partitioner makes, it maintains the functional correctness of the 
design, but will change the cost of the implementation (in terms of the area, clock 
cycles and so forth). The user may direct the partitioner to choose one of the options 
in preference to the others. A number of the options are described below. 

1 0 Pure hardware 

The partitioner could map the first two processes directly into Handel-C, after 
performing some additional parallelisation. The problem with this approach is that 
each one of the operations in the mass motion process will be dedicated to its own 
1 5 piece of hardware, in an effort to increase performance. However, as discussed above, 
this is unnecessary as these calculations can be performed at a slower speed. The result 
is a design that can perform quickly enough but which is too large to fit on a single 
FPGA. This problem would be recognised by the partitioner using its area estimation 
techniques. 

20 

Pure software 

An alternative approach is for the partitioner to map the two processes into 
software running on a parametrised threaded processor. This reduces the area required, 

25 since the repeated operations of the mass motion calculations are performed with a 
single operation inside the processor. However, since the processor must swap 
between doing the mass motion calculations and the rendering calculations, overhead 
is introduced which causes it to run too slowly to display in real-time. The partitioner 
can recognise this by using the speed estimator, based on the profiling information 

30 gathered from simulations of the system. 
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Software/software 

Another alternative would be for the partitioner to generate a pair of 
parametrised processors running in parallel, the first calculating motion and the second 
5 performing the rendering. The area required is still smaller than the pure hardware 
approach, and the speed is now sufficient to implement the system in real time- 
However, using a parametrised processor for the rendering process adds some 
overhead (for instance, performing the instruction decoding), which is unnecessary. So 
although the solution works, it is sub-optimal. 

10 

Hardware/Software 

The best solution, and the one chosen by the partitioner, is to partition the 
mass motion process into software for a parametrised, unthreaded processor, and to 
1 5 partition the rendering process 74 which was written at a behavioural level together 
with the position, velocity and acceleration calculations 72 into hardware. This 
solution has the minimum area of the options considered, and performs sufficiently 
quickly to satisfy the real time display process. 

Thus referring to Figure 7, the behavioural part of the system 70 includes the 
20 calculation of the positions, velocities and accelerations of the masses at 72 (which will 
subsequently be partitioned to software), and the line and drawing processes at 74 
(which will subsequently be partitioned to hardware). The RTL hardware 80 is used 
to receive the input from the buttons at 82 and output the video at 84. 

Thus the partitioner 7 used the estimators 19, 21 and 23 to estimate the speed 
25 and area of each possible partition based on the use of a customised processor. The 
interface cosynthesiser 9 implements the interface between hardware and software on 
two FPGA channels 71 and 73 and these are used to transfer a position information to 
the rendering process and to transfer the button information to the position 
calculation 72 from button input 82. 
30 The width adjuster 5, which is working on the mass motion part of the 

problem to be partitioned to software, parametrises the processor to have a width of 
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17 bits and adjusts the width of "currjios" which is the current position to nine bits, 
the width of the segment channel. The processor parametriser at 17 further 
parametrises the processor by removing unused instructions such as multiply, 
interrupts, and the data memory is reduced and multi-threading is removed. Further, 
op codes are assigned and the operator width is adjusted. 

The description of the video output 84 and button interface 82 were, in this 
case, written in an RTL language, so there is no behavioural synthesis to be done for 
them. Further, because the hardware will be formed on an FPGA, no width 
adjustment is necessary because the width can be set as desired. 

The partitioner 7 generates a dependency graph as shown in Figure 8 which 
indicates which variables depend on which. It is used by the partitioner to determine 
the communications costs associated with the partitioning, for instance to zssess the 
need for variables to be passed from one resource to another given a particular 
partitioning. 

SUMMARY 

Thus the codesign system of the invention has the following advantages in 
designing a target system:- 

1. It uses parametrisation and instruction addition and removal for 
processor design in an FPGA tailored to the application. The system provides an 
environment in which an FPGA-based processor and its compiler can be developed in 
a single framework, 

2. It can generate designs containing multiple communicating processors, 
parametrised custom processors, and the inter-processor communication can be tuned 
for the application* 

3. The hardware can be designed to run in parallel with the processors to 
meet speed constraints. Thus time critical parts of the system can be allocated to 
custom hardware, which can be designed at the behavioural or register transfer level. 

4. Non-time critical parts of the design can be allocated to software, and 
run on a small, slow processor. 
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5. The system can target circuitry on dynamic FPGAs. The FPGA can 
contain a small processor which can configure and reconfigure the rest of the FPGA at 
run time. 

6. The system allows the user to explore efficient system implementations, 
5 by allowing parametrised application-specific processors with user-defined instructions 

to co mm u ni cate with custom hardware. This combination of custom processor and 
custom hardware allows a very large design space to be explored by the user. 
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Appendix 1 



Register transfer level description of simple processor 



10 



15 



20 



void sw ( ) 

{ 

#def ine iw = 12 ; 

#define mw » 3; 
#define CONST = 
#def ine LOAD = 1 
#def ine GLOBAL = 
#define PUT CHAR i 



^define GET CHAR =16 



/* instruction 
width */ 
/* memory address width */ 
3 /* push constant */ 

/* push variable */ 
2 /* push address */ 

s 15 /* put a character 

along the 
standard output 
channel */ 
/* get a character 

from the standard 
input channel */ 



rom program [ 3 = { 
25 #include "prog.o" 

}; 

ram stack [l<<mwj with { dualport = 1 } ; 
ram memory [l<<mw] / 
unsigned iw pc, ir, tos; 
30 unsigned mw sp; 

do { 
par { 

ir = program [pc] ; 
35 pc s pc + 1; 

tos = stack tsp-1] ; /* save top of 

stack to avoid 
two ram accesses 
in one cycle 

40 /* 
} 

switch (ir) { 
case CONST : 
par { 

45 stack [sp] = program tpc] ; 

sp a sp+l; 
pc = pc+l; 

} 

break; 

50 case LOAD : 
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stack [sp-1] = memory [tos<-mw] 
break ; 



case STOP ; 

breaks- 
default ; /* unknown opcode */ 

while (1) delay; 

10 } 

} while (ir J = STOP) / 



15 Appendix 2 

RTL description of main 



20 



25 



void main ( ) 

{ 

chan hwEwchan; 

Chan unsigned 8 port; 



par { 

parallel_port (port) ; 
SyncGen ( ) ; 

{ 

30 initialiseRam (port) ; 

par { 

•display (hwswchan) 
sw (hwswchan) ; 

} 

35 } 
} 



40 Appendix 3 



CALCULATION PROCESS 

45 

* Channel communicating object positions 
*/ 

chan unsigned 17 position; 

50 

/* 

* Channel communicating segment information 
*/ 
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chanout unsigned 9 segment; 

/* 

* Channel communicating button information 
5 */ 

chanin unsigned 2 buttons ; 

/* 

* Overall par 
10 */ 

par 
{ 

/* 

* Mass motion 
15 */ 
{ 

/* 

* Positions of each mass, 9+8 fixed point 
*/ 

20 unsigned 17 pO, pi, p2, p3 , p4 , p5, p6, p7 ; 

/* 

* Velocity of each mass, 9+8 fixed point 
*/ 

25 int 17 vl, v2, v3, v4 , v5, v6, v7; 

/* 

* Accelerations of each mass, 9+8 fixed point 
*/ 

30 int 17 al, a2, a3 , a4 , a5, a6, a7; 

/* 

* Button status 
*/ 

35 unsigned 2 button_status ; 

/* 

* Initial setup of positions 
V 

40 pO = 65536; 

pi » 65536; 

p2 = 65536; 

p3 = 65536; 

p4 s 65536; 
45 p5 * 65536; 

p6 « 65536; 

p7 s 65536; 

/* 

50 * Porever. . . 
*/ 

while (1) 
{ 
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* Send successive positions down position channel 



*/ 






send 


(position, 


pO) ; 


send 


(position, 


pi) ; 


send 


(position, 


pi) ; 


send 


(position, 


p2) ; 


send 


iposi cion , 


/ t 


send 


(position, 


p3) ; 


send 


(position. 


p3) ; 


send 


(position, 


p4) ; 


send 


(position, 


p4) ; 


send 


(position, 


p5) ; 


send 


(position. 


p5) ; 


send 


(position, 


p6) ; 


send 


(position, 


p6) ; 


send 


(position, 


p7) ; 


/* 







20 * Update positions according to velocities 

•/ 





Pl 


+ = 


(unsigned 17) 


vl; 




p2 


+ = 


(unsigned 17) 


V2; 




P3 


+= 


(unsigned 17) 


V3; 


25 


P 4 


+= 


(unsigned 17) 


V4 ; 




P5 


+= 


(unsigned 17) 


V5; 




p6 


«+ = 


(unsigned 17) 


v6; 




P7 


+= 


(unsigned 17) 


V7; 


30 


/* 









* Update velocities according to accelerations 
*/ 



35 



Vl 




al - 


- (vl 




6) ; 


v2 




a2 - 


(v2 


>> 


6) ; 


v3 




a3 - 


■ (v3 


>> 


6) ; 


v4 




a4 - 


(v4 


>> 


6) ; 


v5 


+ = 


a5 - 


• (v5 


>> 


6) ; 


v6 




a6 - 


• (v6 


>> 


6) ; 


v7 




a7 - 


(v7 


>> 


6) ; 



40 

/• 

* Set accelerations according to relative positions 
V 







al 


e 


(int 


17) 


( 


( ( 


p2 


>> 


8 


) 


- ( 


PI 


>> 


8 


) 


) 


45 


( 


( p0 


>> 


8 ) 


- ( 


Pi 


>> 


8 


) ) 


) ; 




















a2 




(int 


17) 


( 


( ( 


p3 


>> 


8 


) ■ 


■ ( 


P 2 


>> 


8 


) 


) 




( 


( Pi 


>> 


8 ) 


- ( 


p2 


> > 


8 


) ) 


) ; 




















a3 




(int 


17) 


( 


( ( 


P 4 


>> 


8 


) • 


■ ( 


P3 


>> 


8 


) 


) 




( 


( P2 


>> 


8 ) 


- ( 


P3 


> > 


8 


) ) 


) ; 
















50 




a4 


= 


(int 


17) 


( 


( ( 


PS 


>> 


8 


) - 


( 


P 4 


>> 


8 


) 


) 
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( p5 » 8 ) ) + 



( ( p3 >> 8 ) - ( p4 >> 8 ) ) ) ; 

a5 = (int 17) ( < < p6 >> 8 > 

( ( p4 >> 8 ) - ( p5 >> 8 ) ) ) ; 

a6 = (int 17) ( ( ( p7 » 8 ) - ( p6 » 8 ) ) ♦ 

5 ( ( p5 » 8 ) - ( p6 » 8 ) ) ) ; 

a7 = (int 17) ( ( p6 >> 8) - ( p7 >> 8) ) ; 



* Get button information 
10 */ 

receive (buttons, button_status) ; 



15 



20 



25 



* Fix top point according to buttons 
*/ 

if (button_status & l) 

pO = 65536 - 16384; 
else if (button_status & 2) 

pO = 65536 + 16384; 



else 



pO = 65536; 



30 



35 



* Line drawing 
*/ 



* Positions of previous and next masses positions 



unsigned 17 prevjpos , next_pos, curr jpos ; 
40 /* 

* Wnich line of interpolation 
*/ 

unsigned char line; 
45 /* 

* Forever . . . 
*/ 

while (1) 
{ 
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/* 

* Receive previous mass position 
V 

receive (position, prev_pos) ,- 
5 curr_pos = prev_pos; 

/* 

* Read next mass position 
*/ 

10 receive (position, next_pos) ; 
/* 

* Do 64 lines of interpolation 
*/ 

15 for (line - 0; line ! =64/ line++) 
{ 

/* 

* Send start position of segment 
*/ 

20 send (segment, curr_pos >> 8); /**width adjustment : 17 

along 

channel of 

width 9 so takes bottom 9 bits */ 

25 /* 

* Move by appropriate amount (1/64 total change) 
•/ 

currj)os += (unsigned 17) ( ( (int 17) nextjpos 

(int 17) prev__pos) >> 6) ; 



30 



35 



/* 

* Send end position of segment 
*/ 

send (segment, curr_jpos >> 8) ; 



} 

} 

40 

DISPLAY PROCESS 



/* standard includes */ 
45 # include ,, hammond.h M 
# include M syncgen . h " 
#include » s tdlib . h » 
#include "parallel , h M 

50 /* 

* Segment information channel 
*/ 

chan segment; 
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/* 

* Button information channel 
*/ 

chan buttons 

5 

/* 

* Include dash generated stuff 
*/ 

# include "Handelc.h" 

10 

/* 

* Main program 
*/ 

void main ( ) 
15 { 

/* 

* Scan positions 
*/ 

unsigned sx, sy; 

20 

/* 

* Video output register 
*/ 

unsigned 1 video; 

25 

/* 

* Video output bus 
*/ 

interface bus_out ( ) video out (Visible (sx, sy) ? 
30 (video ? (unsigned 12) 

Oxfff 0) 

: 0) with video_spec; 

fcifndef simulate 
35 /* 

* Left button input bus 

V 

interface bus_in (unsigned 1) button_left ( ) 
with button_white_ spec ,- 

40 

/* 

* Right button input bus 
*/ 

interface bus_ in (unsigned 1) button_right ( ) 
45 with button_black_spec ; 

flendif 

/• 

* Overall par 
50 */ 

par 

{ 

/• 
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* VGA sync generator 
*/ 

SyncGen <sx, sy, hsync_pin. vsyncjpin) ,- 
5 /* 

* Dash generated hardware 
*/ 

hardware ( ) ; 
10 /* 

* Run- length decoder 
*/ 

{ 

/* 

j5 * segment start and end posxtions 

*/ 

unsigned start, end; 

/* 

20 * Forever . . . 

*/ 

while (1) 
{ 

while (sy != 448) 

25 { 

/* 

* Read segment information 
*/ 

segment ? start; 
30 segment ? end; 

/* 

* Get in the right orfer 
*/ 

35 if (start > end) 

{ 

par 

t 

end = start; 
start = end; 

) 

} 



40 



/* 

45 * Make at least 1 pixel visible 

if (start == end) 
end++ ; 

50 /* 

* Wait . . . 
*/ 

while (sx ! - 0) 
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delay; 

/* 

* Draw a scanline worth 
5 */ 

while (sx != 512) 
( 

if ( (sx <- 9) >= start (sx <- 9) < end) 

{ 

10 video = 1; 

) 

else 

{ 

15 video = 0,- 



} 

} 



} 



20 /* 

* Communicate button status 
V 

tfifdef SIMULATE 

buttons ! 1; 

25 #else 
#endif 



buttons ! -button_left .in @ ~button_r ight . in ; 



* Wait 
30 */ 



while (sy != 0) 
delay; 

) 



35 

} 
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CLAIMS 

1. A codesign system for producing a target system having configurable resources to 
5 provide specified functionality by: 

(a) operation of dedicated hardware; and 

(b) complementary execution of software on one or more software-controlled 
machines; 

the codesign system comprising means for receiving a specification of said functi o nali t y, 
1 0 partitioning means for partitioning implementation of said functionality between (a) and 
(b) and for customising said hardware and/or said machines in accordance with the 
selected partitioning of the functionality. 

2. A codesign system according to claim 1, wherein said partitioning means 
15 produces an optimised target system by applying a genetic algorithm to different 

partitions of said functionality with selection based on specified criteria. 

3. A codesign system according to claim 2 wherein said partitioning means 
comprises means for generating a plurality of different partitions of said functionality, 

20 said codesign system comprises estimator means for estimating at least one of the speed 
and size of the hardware and/or software-controlled machine, and said partitio ning 
means comprises means for selecting from said different partitions on the basis of the 
estimate. 

25 4. A codesign system according to claim 1, 2 or 3 wherein the parameters of the 
software controlled machine are adapted during the partitioning of said functionality. 

5. A codesign system according to claim 1, 2, 3 or 4 wherein said software- 
controlled machine comprises a processor, DSP or core. 

30 

6. A codesign system according to claim 5 further comprising means for generating 
a compiler for said processor, DSP or core. 
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7. A codesign system according to claim 5 or 6 wherein the processor, DSP or core 
is formed on a configurable logic circuit. 

8. A codesign system according to claim 5 or 6 wherein the processor, DSP or core 
5 is formed as an ASIC. 

9. A codesign system according to claim 5 or 6 wherein the processor, DSP or core 
is a predesigned processor. 

10 10. A codesign system according to any one of the preceding claims, wherein the 
dedicated hardware is defined on a configurable logic circuit. 

11. A codesign system according to claim 7 or 10 wherein the configurable logic 
circuit comprises an FPGA. 

15 

12. A codesign system according to any one of the preceding claims, further 
comprising:- 

an interface cosynthesiser for defining interfaces between the hardware and 
software-controlled machine; and 
20 a software compiler for compiling those parts of the functionality partitioned to 

software to produce corresponding machine code for execution on the software- 
controlled machine. 

13. A codesign system according to claim 10 or any claim dependent therefrom, 
25 further comprising a hardware compiler for producing from those parts of the 

functionality partitioned to hardware a register transfer level description for configuring 
the configurable logic resources. 

14. A codesign system according to claim 13 further comprising a register transfer 
30 level synthesiser for converting the register transfer level description into a netlist for 

configuring the configurable logic resources. 
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15. A codesign system according to claim 12 or any claim dependent therefrom 
further comprising an interface estimator for estimating the speed and area of the 
interfaces. 

5 16. A codesign system according to any one of the preceding claims further 
comprising a width adjuster for setting a desired data word size. 

17. A codesign system according to any one of the preceding claims wherein the 
partitioning means comprises a parser for parsing an input behavioural description of 

10 the desired functionality of the target system. 

18. A codesign system according to claim 17 wherein the partitioning means is 
adapted to respond to one of a plurality of predefined attributes in the description to 
perform at least one of the following:- 

15 schedule parallel execution of processes on the hardware and on the software- 

controlled machine; 
partition functions to software; and 
partition functions to hardware. 

20 19. A codesign system according to cl aim 17 or 18, further comprising means for 
receiving a declaration of the properties of at least one of the hardware and the software- 
controlled machine. 

20. A codesign system according to claim 18 wherein the declaration is in an object- 
25 oriented paradigm. 

21. A codesign system according to any one of claims 17 to 20 wherein the 
partitioning means is adapted to receive a register transfer level description of selected 
aspects of the target system. 

30 

22. A codesign system according to claim 7, 10 or 11, further comprising means for 
configuring the configurable logic resources. 
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23. A codesign system according to any one of the preceding rising further 
comprising memory access tracing means for tracing and recording memory accesses. 

24. A codesign system according to any one of the preceding f1aim$ further 

5 comprising address space partitioning means for allocating an address space to variables 
or functions in said specification of functionality and unifying means for unifying the 
address space of variables and functions with mutual operations. 

25. A codesign system constructed and arranged to operate substantially as 
10 hereinbefore described with reference to and as illustrated in the accompanying 

drawings. 



SUBSTITUTE SHEET (RULE 26) 



WO 00/38087 



PCT/GB99/04338 



Hierarchy of 
processor 

descriptions, 
compilers 

and estimators 



1/9 

C-like input description 
3 



Fig.1 



1 



Parser 

~T~ 



System 
description from 
any level in flow 

19n 



Width 
Adjustment 




Simulation 
and 
Profiling 



Partitioning 



Software^ f 
9 



Hardware 
Estimators 



Interface 
Co-synthesis 




Interface 
Estimators 



Software, 



.Hardware 



Iterate 



Width 
Adjustment 



5a 



Software 
Compilation 



15 




13 





5b 


Width 




Adjustment 




i — 




Behavioural 


11 


Synthesis 




* 




RTL 






Synthesis 






I 









Machine Processor Cwith Netlist RTL Behavioural 
code description lightweight description description 

threads 



SUBSTITUTE SHEET (R ULE 26) 



WO 00/38087 



PCT/GB99/04338 



2/9 











"ol 




om 


CD 2 


o 


tware 




«+— 




o 




CO 





© 




)mpi 


compile 

print 
simulate 


ocBCc 


Q_ 









Diler 


tate 
heel 
late 


om| 


go i 
£ §. e 


o 


(0 j£ CO 



CM 

• MM 




SUBSTITUTE SHEET (R ULE 26) 



WO 00/38087 



3/9 



PCT/GB99/04338 



Fig.3. 



VGA 




Parallel Port 




RS232 












Video DAC 




FPGA 
Xilinx 4013XL 




Level 
Converter 


SSRAM 
64Kx32bit 


Oscillator 
Auxiliary I/O 



Fig.4. 




SUBSTITUTE SHEET (RULE 26) 



WO 00/38087 



PCT/GB99/04338 



4/9 




Fig. 5. 



FPGA download 
(from workstation) 





VGA Parallel Serial 
out port port 

Hammond board 



Telephone 



1 



Modem 





SUBSTITUTE SHEET (R ULE 26) 



WO 00/38087 



PCT/GB99/04338 



5/9 



3 
O 

o 

CD 

> 



0C 





O) 




«♦-• 


c 




x: 


*c 








CD 






E 


Q. 


eo 


O) 
0) 


"3 


vid 




O 





s 



c 

<D CO 

i is 

CO w 



d> 

LL 



2 
g 
5 

CD 
CO 



s 



CM 
CO 
\ 



c o 

O CO 

t: 

CD ^ 



■o 
c 
a> 

tr 
iS 

CO 



8 * £2 

— co o 

5 (I) N 

2 co ^ 



CD 

E 
a> 

CD 
CO 



CO 



"j2 to 
co co o cd 

lisp 

(5 S o i = 
° R -§ § ° 



o 

00 



3 £ 

CD 



0Q 



co 
c 
o 

CO 




o 



SUBSTITUTE SHEET (RULE 26) 




CO 
CD 







c 


c 


o 


o 


O 


O 


CO 


00 


ri> 


Li. 


Ll 


00 


ont ii). 




o 


u. 


00 




d) 




Li. 



SUBSTITUTE SHEET (RULE 26) 



WO 00/38087 



PCT/GB99/04338 




SUBSTITUTE SHEET (RULE 26) 



WO 00/38087 



PCT/GB99/04338 




SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



Intet. onal Application No 

PCT/GB 99/04338 



A. CLASS! FICATION OF SUBJECT MATTER 

IPC 7 G06F17/50 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (ciassifi cation system followed by classification symbols) 

IPC 7 G06F 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Bectronic data base consulted during the international search (name of data base and. where practical, search terms used) 



Category ° 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to daim No. 


X 


EDWARDS M D ET AL: "SOFTWARE ACCELERATION 


1,5, 




USING PROGRAMMABLE HARDWARE DEVICES" 


9-11,13, 




IEE PROCEEDINGS: COMPUTERS AND DIGITAL 


14,22 




TECHNIQUES, GB,IEE, 






vol. 143, no. 1, 






1 January 1996 (1996-01-01), pages 55-63, 






XP000554820 






ISSN: 1350-2387 


3,12,17, 


A 


paragraphs '0001! , *0003! , '0004! ; figures 




1-7 


18,24 


X 


WO 94 10627 A (GIGA OPERATIONS CORP 


. 1.5. 




; TAYLOR BRAD (US); D0WLING ROBERT (US)) 


9-11,13, 




11 May 1994 (1994-05-11) 


14,22 


A 


page 8, line 5 - line 23 


17,18,24 




page 35, line 5 -page 41, line 11 






figures 17,21 






-/— 





m 



Further documents are listed in the continuation of box C. 



ID 



Patent family members are listed in annex. 



• Special categories of cited documents : 

*A" document defining the general state of the art which is not 
considered to be of particular relevance 
eariler document but published on or after the international 
filing date 

*L" document which may throw doubts on priority cfaim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

*0" document referring to an oral disclosure, use. exhibition or 
other means 

*P" document published prior to the International filing date but 
later than the priority date claimed 



T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X* document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent famfly 



Date of the actual completion of the international search 

24 May 2000 


Date of mailing of the international search report 

09/06/2000 


Name and mailing address of the ISA 

European Patent Office. P.B. 5816 Palenrlaan 2 
NL-2280 HV Rijswijk 
Tel. (+31-70) 340-2040. Tx. 31 651 epo nl, 
Fax: (+31-70)340-3016 


Authorized officer 

Guingale, A 



Form PCT/ISA/210 (second sheai) (July 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Intel anal Application No 

PCT/GB 99/04338 



C(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indtcation.where appropriate, of the relevant passages 



Relevant to claim No. 



P.X 



WO 97 13209 A (ERICSSON TELEFON AB L M 
; ANDERSSON ROEJAAS KARL GUNNAR (SE)) 
10 April 1997 (1997-04-10) 
abstract 

page 2, line 8 -page 4, line 3 

EP 0 772 140 A (IMEC INTER UNI MICRO 
ELECTR) 7 May 1997 (1997-05-07) 

abstract 

column 13, line 6 - line 55 
column 19, line 24 -column 24, line 41 
figures 2,6,7 

LECHNER E ET AL: "The Java Environment 
for Reconf igurable Computing" 
INTERNATIONAL WORKSHOP ON FIELD 
PROGRAMMABLE LOGIC AND APPLICATIONS, 
FPGAS,GB, ABINGDON, 

1 September 1997 (1997-09-01), pages 
284-293, XP002086682 

paragraph '0002! 

figures 1,2 

SAUL J M: "Hardware/software codesign for 
FPGA-based systems" 
PROCEEDINGS OF THE 32ND ANNUAL HAWAII 
INTERNATIONAL CONFERENCE ON SYSTEMS 
SCIENCES. 1999. HICSS-32. ABSTRACTS AND 
CD-ROM OF FULL PAPERS, PROCEEDINGS OF 
HICSS 32 - 32ND ANNUAL HAWAII 
INTERNATIONAL CONFERENCE ON SYSTEM 
SCIENCES, MAUI, HI, USA, 5-8 JAN., page 10 
pp. XP002138152 

1999, Los Alamitos, CA, USA, IEEE Comput. 
Soc, USA ISBN: 0-7695-0001-3 
the whole document 



6,8,17, 
19 



1,9, 

12-14, 

17,18,24 



1,7,10, 
11 



1-25 



Form PCT/ISA/210 (continuation of second sheet) (Juty %992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



Intel anal Application No 

PCT/GB 99/04338 



"aiyj u aocurneni 


■ 

Publication 




r aieni ramify 


r uDiicauon 


cited In search report 


date 




member(s) 


date 


WO 9410627 A 


11-05-1994 


US 


5535342 A 


09-07-1996 






AU 


5458194 A 


24-05-1994 






CA 


2148813 A 


11-05-1994 






EP 


0746812 A 


11-12-1996 






JP 


8504285 T 


07-05-1996 






All 

AU 


CCQ1CQ/1 A 

bbyjby** A 








CA 


2148814 A 


11-05-1994 






EP 


0667010 A 


16-08-1995 






JP 


8504514 T 


14-05-1996 






WO 


9410624 A 


11-05-1994 






US 


5497498 A 


05-03-1996 






US 


5603043 A 


11-02-1997 






us 


bob/109 A 


AC ni mnn 

ub-oi-iyyy 


WO 9713209 A 


10-04-1997 


SE 


505783 C 


06-10-1997 






All 




9ft— (\A— 1 QQ7 

co uh iyy/ 






CA 


2233843 A 


10-04-1997 






CN 


1202972 A 


23-12-1998 






EP 


0853792 A 


22-07-1998 






JP 


11513512 T 


16-11-1999 


EP 0772140 A 


07-05-1997 


EP 


0767544 A 


09-04-1997 






US 


5870588 A 


09-02-1999 



Fomi PCT/JSA/210 (patent tamayannox> (July 1992) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 



□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




FADED TEXT OR DRAWING 



